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Abstract 



Let G(x,y) and Go{x,y) be the Green functions of rotationally invariant symmetric te- 
stable process in R d and in an open set D respectively, where < a < 2. The inequal- 
ity GD(x,y)GD{y,z)/GD{%,z) < c(G(x,y) + G{y,z)) is a very useful tool in studying (local) 
Schrodinger operators. When the above inequality is true with c = c(D) e (0,oo), then we say 
that the 3G theorem holds in D. 

In this paper, we establish a generalized version of 3G theorem when D is a bounded k- 
fat open set, which includes a bounded John domain. The 3G we consider is of the form 
GD(x,y)GD{z,w)/GD{x,w), where y may be different from z. When y = z, we recover the 
usual 3G. 

The 3G form Gd{x, y)Gu{z, w)/Gd(x, w) appears in non-local Schrodinger operator theory. 
Using our generalized 3G theorem, we give a concrete class of functions belonging to the non- 
local Kato class, introduced by Chen and Song, on K-fat open sets. 

As an application, we discuss relativistic a-stable processes (relativistic Hamiltonian when 
a = 1) in K-fat open sets. We identify the Martin boundary and the minimal Martin boundary 
with the Euclidean boundary for relativistic a-stable processes in K-fat open sets. Furthermore, 
we show that relative Fatou type theorem is true for relativistic stable processes in K-fat open 
sets. 

The main results of this paper hold for a large class of symmetric Markov processes, as are 
illustrated in the last section of this paper. We also discuss the generalized 3G theorem for a 
large class of symmetric stable Levy processes. 
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1 Introduction 



The 3G theorem is crucial to prove the conditional gauge theorem which says that the ratio of 
Green functions of the symmetric a-stable process with < a < 2 and its local perturbation in the 
Kato class, is either identically infinite or bounded above and below by two positive numbers. 

When a = 2, we have a Brownian motion. Here, the Kato class, -fQ.ct) < a < 2, d > 2, is the set 
of Borel functions q on H d satisfying 

,. f \q(y)\ , n 

nm sup / | vj^dy = 0. 

r l° x£R d J\x-y\<r F ~ y\ a ° 



For d = a = 2, — In \x — y\ replaces \x — y\ a ~ (see [1£ 

Cranston, Fabes and Zhao |19j proved the 3G theorem of the Brownian motion in a bounded 
Lipschitz domain D C R d , d > 3, saying that there exists a positive constant c depending only on 
D such that 

G D (x,y)G D (y,z) 2 _ d 2 _ d 



G D (x,z) 



< c{\x-y\ 2 - a + \y-z\ 2 - d }, x,y,z£D, (1.1) 



where Gd is the Green function of the Brownian motion in D. (jl.lj) was recently extended to 
bounded uniformly John domains, D C R d , d > 3, by Aikawa and Lundh PP (see [21 1241 Pfil 140] 
for d = 2). The conditional gauge theorem for the Brownian motion is of great importance to 
study the Green function of the nonrelativistic Schrodinger operator with a local perturbation in 
D, —A + q(x), for q in the Kato class, K^^, d > 2. Here, the free Hamiltonian, —A, is related 
to the kinetic energy and q is its potential energy. The point of the negative sign in front of the 
Laplacian is to have that the spectrum of the free Hamiltonian is [0, oo). 

For the symmetric a-stable process with a £ (0,2), the 3G theorem is also used to show the 
conditional gauge theorem. The infinitesimal generator of the symmetric a-stable process is the 
fractional Laplacian (— A) a / 2 which is non-local (for example, see JH])- The 3G theorem for the 
symmetric a-stable process was first established and used by Chen and Song ^3 El hi a bounded 
C 1 ' 1 domain D C R d , d > 2. They prove that there exists a positive constant c = c(D, a) such 
that 

G D (x,y)G D (y,z) \x - z\ d ~ a 

^r~, \ < c-. f-j — : r-j — , x,y,z£D, (1.2) 

G D (x,z) ~ \x -y\ d ~ a \y - z\ d - al ' y J 

where Gd is the Green function of the symmetric a-stable process in D. Later, (jl.2|) was extended 
to a more general domain which is called a bounded K-fat open set (a disconnected analogue of 
John domain, for the definition see Definition 12. 3|) by Song and Wu |38j . 

However, to prove the conditional gauge theorem of the symmetric a-stable process with a 
certain class (the non-local Kato class) of a non-local perturbation (for details, see section QJ, we 
need to generalize the 3G theorem. It is the main objective of this paper to establish the inequality 
below. 
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Theorem 1.1 (the Generalized 3G theorem) Suppose that D is a bounded n-fat open set and 
that Gr>(x,y) is the Green function for the symmetric a-stable process in D with a £ (0,2) and 
d > 2. Then there exist positive constants c = c(D, a) and 7 < a such that for every x,y, z,w £ D 

G D (x,y)G D (z,w) < ( \x - w\ A \y - z\ \ 7 / \x - w\ A \y - z\ \ 7 \x - w\ d ~ a 

Gd(x,w) \ \x — y\ J \ \z — w\ J \x — y\ d ~ a \z — w\ d ~ a 

(1.3) 

where a A b := min{a, b}, a V b := max{a, b}, here and below. 



The reason to call Theorem 11.11 the Generalized 3G theorem is that it plays the same role in 
non-local perturbations as the 3G theorem (|1.2I) in local perturbations, and that we recover the 
(classical) 3G theorem (|1.2|) by letting y = z in ()1.3|) . The inequality (|1.3|) is not true without the 
first two factors in the right-hand side of (|1.3|) (see Remark 13. 19|) . 

In order to describe why one needs the generalized 3G theorem, we introduce the measure P™ 
for the conditioned process obtained from killed process X D (killed upon leaving D) through Doob's 
/i-transform with h(-) = Gd(-,w) (for details, see section 4 below) and use notations 

n , \ G D {x,y)G D {z,w) 

G(x, y, z, w) := — — r and G(x, z, w) := Gtx, z, z, w). 

G D {x,w) 

When a = 2, the (killed) symmetric a-stable process X D in D is the Brownian motion with 
infinitesimal generator —A in D. For q in the Kato class, -Kd,2, define a Schrodinger semigroup by 



tf(x) := 



exp (J q(X?)ds\ f(X t D ) 



t > 0, x £ D. 



;i.4) 



A major tool to prove the comparison (conditional gauge theorem) between Green functions, Gd 
and Vdi of —A and —A + q, respectively, is 3G theorem and the identity 



E! 



TD 



q(X°)ds 



j G(x, z,w)q(z)dz, (x,w) £ D x D 
Jd 



(1.5) 



(see page 191 in |18|). Then the conditional gauge theorem says that the comparison between Green 
functions is given by the form: 



V D (x,w) 



E* 



cxp 



q(X?)ds 



(x,w) £ D x D 



G D (x,w) 

and the above is either identically infinite or bounded above and below by positive constants (see 
OH for details). 

On the other hand, for a £ (0,2), a symmetric a-stable process X in an open set D with 
infinitesimal generator (— A) a / 2 has discontinuous sample paths. So there is a large class of additive 
functionals of X D which are not continuous. Additive functionals of the form 

A q+F (t)= f qiX^ds + Y^FiXf-^l 
Jo ~z 



s<t 
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constitute an important class of discontinuous additive functionals of X D (for example, see |13|). 
Here q is a Borel-measurable function on D and F is some bounded Borel measurable function on 
D x D vanishing on the diagonal. As a generalization of (fl .41) . such an additive functional defines 
a Schrodinger (Feynman-Kac) semigroup by 

T t f(x) := E x [exp (A q+F (t)) f(X t D )] , t>0,x£D 

having infinitesimal generator of the form 

(-A)»/ 2 /(x) + g(x)f(x) + A(d, -a) [ (e F ^ - l)f(y)\x - y\~ d - a dy 

JD 

where A(d, —a) is a constant depending only on d and a (see Theorems 4.6, 4.8 and Corollary 4.9 
in [Ej). The Schrodinger operator of the above type has been studied in El E3 EH EH E7J ■ ^ n 
particular, Chen and Song [SJ introduced the various new Kato classes and proved conditional 
gauge theorems for a large class of Markov processes. The new non-local Kato class in jSJ EH is 
given in terms of G(x, y, z, w). The counterpart of (|1.5|) is 

\A q+F (r D )} = / G(x,z,w)q(z)dz + A{d, -a) / G(x,y, z,w)F(y, z)\y - z\- d ~ a dydz. 

JD JD JD 

So to give a concrete class of functions belonging to the non-local Kato class, it is necessary to 
derive some inequality to handle G(x, y, z, w). In fact, if D is smooth, by Green function estimates 
(for example, see Chen and Song 13. give a sufficient condition for F to be in the new 

Kato class. 

In this paper, we establish the inequality to deal with the generalized 3G form G(x,y,z,w). 
Using this inequality, we show that the sufficient condition given in |13j works for any bounded 
K-fat open set (see Theorem 14 .3(1 . An interesting thing on the exponent, 7, is that once we find a 
constant 7 less than a, 7 will not affect the concrete condition at all. 

As an application of the concrete class of functions belonging to the non-local Kato class, we 
consider the relativistic a-stable process in a bounded K-fat open set. When a = 1, the infinitesimal 
generator of this process is the free relativistic Hamiltonian y/—A + m 2 — m. Here the kinetic 
energy of a relativistic particle is V— A + m? — m , instead of —A for a nonrelativistic particle. 
The reason to subtract the constant m in the free Hamiltonian is to ensure that its spectrum is 
[0,oo) (see (7j). There exists a huge literature on the properties of relativistic Hamiltonian (for 
example, [71 1201 U2\ I32| 13*3*] ) . Recently relativistic a-stable process with the infinitesimal generator 
(-A + m 2 l a ) a / 2 - m has been studied by Chen and Song [Tl], Kim j^H], Kulczycki and Siudeja 
[3T] . Ryznar [35] . 

In this paper, we show that, in any bounded re-fat open set, Green functions and Martin 
kernels of relativistic stable process are comparable to the ones of symmetric stable process. Using 
recent results in 1 1,1. , we identify the Martin boundary and the minimal Martin boundary with the 
Euclidean boundary for relativistic a-stable process in re-fat open set. In |28j . the first named author 



5 



studied the boundary behavior of the ratio of two harmonic functions of Schrodinger operators of 
the above type. As a consequence of the results in and the generalized 3G inequality, we show 
that relative Fatou type theorem is true for the relativistic stable process in a K-fat open set. 

Our method works for other classes of symmetric Levy processes. However to make the ex- 
position as transparent as possible, we choose to present our results for (rotationally invariant) 
symmetric stable processes. Extensions to other classes of symmetric Levy processes are men- 
tioned at the end of the paper. 

The rest of the paper is organized as follows. In section 2 we collect basic definitions and prop- 
erties of symmetric stable processes. Section 3 contains the proof of the generalized 3G theorem. 
In section 4, through the generalized 3G theorem, a concrete condition is given for functions to be 
in the non-local Kato class. Using the condition, the Martin boundary and the boundary behavior 
of harmonic functions for relativistic stable processes in bounded re-fat open sets are studied. In 
section 5, some extensions of the main results of this paper to more general symmetric Markov 
processes are given. As an example, we show the generalized 3G theorem is true for some class of 
symmetric stable Levy processes. 

In this paper, we will use the following convention: The values of the constants Co, Ci, M and 
£\ will remain the same throughout this paper, while the values of the constants c, c\, C2, ■ ■ ■ signify 
constants whose values are unimportant and which may change from location to location. In this 
paper, we use ":=" to denote a definition, which is read as "is defined to be". For any open set U, 
We denote by pu(%) the distance of a point x to the boundary of U, i.e., pu( x ) = dist(x, dU). 



2 Preliminary 

In this section, We recall the definition of a rotationally invariant symmetric stable process and 
collect its properties, which we will use later. 

Let X = {Xt} denote a (rotationally invariant) symmetric a-stable process in R d with q G (0, 2) 
and d > 2, that is, let Xt be a Levy process whose transition density p(t, y — x) relative to the 
Lebesgue measure is given by the following Fourier transform, 

/ e ix <p(t,x)dx = e-* l?|a . 
Jr.' 1 

The Dirichlet form £ with the domain T associated with X is given by 

£(u,v):= f u(0m\Z\ a d£, ^:={nGL 2 (R d ): / |n(£)| 2 |« < oo}, (2.1) 
Jn d Jn d 



where u(£) := (2tt) d ^ 2 J- Rd e l ^' y u(y)dy (see Example 1.4.1 of |21_). As usual, we define £\\ 
£(u,v) + (n, v)L 2 (R d ) f° r u,v £ J 7 . Another expression for £ is as follows: 

1 x I f (u(x) — u(y))(v(x) — v(y)) , , 

S(u, v) = -A(d, -a) ^ W'yj dxdy, 



U,V 



6 



where A{d, -a) := a2 a - 1 Tr~ d / 2 r( d ^)T(l- § )~\ Here T is the Gamma function defined by T( A) := 
f^t^e^dt for every A > 0. Let 

J(x,y):=^A(d,-a)\x-y\^ d+a \ (2.2) 

J(x, y)dy is called the jumping measure of X. Let Cap be the 1-capacity associated with X (or 
equivalently, with the Riesz potential kernel A(d, — a)\x — y\~ d+a ). A function / is said to be 
quasi-continuous if for any e > there exists an open set U such that Cap(i7) < e and /|j/c is 
continuous. It is known that every function / in T admits a quasi-continuous version. For concepts 
and results related to Dirichlet forms, we refer our readers to |21| . 

For any open set D, we use td = T (D) to denote the first exit time of D, i.e., td = T (D) = 
inf{t > : X t D}. Given an open set D C R d , let XP(uj) = X t (uj) if t < t d (lo) and set 
XP(lu) = d if t > td(oj), where d is a coffin state added to H d . The process X D , i.e., the process 
X killed upon leaving D, is called the symmetric a-stable process in D. Throughout this paper, 
we use the convention f(d) = 0. 

The Dirichlet form of X D is (£,J- D ), where 

T D := {u G T : u = on D c except for a set of zero capacity } (2-3) 
(cf. jH]). Thus for any u,v e T D , 



where 



£(u,v) = / / (u(x) — u(y))(v(x) — v(y))J(x,y)dxdy + / u{x)v{x)nD{x)dx, (2.4) 
Jd Jd 

k d (x) :=A(d,-a) I \x-y\- {d+a) dy. (2.5) 

J D c 

Before we state more properties for a symmetric a-stable process, let's introduce the following 
definitions. 

Definition 2.1 Let D be an open subset of H d . A locally integrable function u defined on H d 
taking values in (— oo, oo] and satisfying the condition J/ a!g n. d -|a;|>i} l n ( x )ll x l < oo is said 

to be 

(1) harmonic for X in D if 

~E x \\u(X TB )\] < oo and u(x) = E x [u(X TB )] , x £ B, 
for every open set B whose closure is a compact subset of D; 

(2) regular harmonic for X in D if it is harmonic for X in D and for each x £ D, 

u{x) = \u(X TD )] ; 



7 



(3) singular harmonic for X in D if it is harmonic for X in D and it vanishes outside D. 



Note that a harmonic function in an open set D is continuous in D (see [5] for an analytic 
definition and its equivalence). Also note that singular harmonic function u in D is harmonic with 
respect to X D , i.e., 

[\u(Xg)\] < oo and u(x) = B x [u(Xg)] , xeB, 

for every open set B whose closure is a compact subset of D. 
We have the Harnack Principle as follows. 



Theorem 2.2 (Bogdan Let x\,x 2 G R d , r > such that \x\ — x%\ < Lr. Then there exists a 
constant J depending only on d and a, such that 

j-i L -(d+*) u ( X2 } < n ( Xl ) < j L d+a u(x 2 ) 

for every nonnegative harmonic function u in B(xx,r) U B(x2,r). 

Here and below, B(x,r) denotes the ball centered at x with radius r. 
We adopt the definition of a K-fat open set from |38j . 

Definition 2.3 Let k € (0, 1/2]. We say that an open set D in H d is K-fat if there exists R > 
such that for each Q G dD and r E (0,R), D n B{Q,r) contains a ball B(A r (Q), nr) for some 
A r (Q) G D. The pair (R, k) is called the characteristics of the K-fat open set D. 

Note that every Lipschitz domain and non-tangentially accessible domain defined by Jerison 
and Kenig in [2f)j are K-fat. Moreover, every John domain is K-fat (see Lemma 6.3 in [SI])- The 
boundary of a K-fat open set can be highly nonrectifiable and, in general, no regularity of its 
boundary can be inferred. Bounded K-fat open set can even be locally disconnected. 

The boundary Harnack principle for K-fat open sets was proved in |38j . 



Theorem 2.4 (Theorem 3.1 in [38]) Let D be a K-fat open set with (R,k). Then there exists a 
constant c = c(d, a) > 1 such that for any Q G dD, r G (0, R) and functions u,v > in TL d , regular 
harmonic in D n B(Q, 2r), vanishing on D c n B(Q, 2r), we have 

c -^^m < ^1 < ck-^^M, x G D n B (Q, l 
v(A r (Q)) v(x) v(Ar(Q))' 
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It is well known that there is a positive continuous symmetric function Gd(x, y) on (DxD)\{x 
y} such that for any Borel measurable function / > 0, 



T ° f(X s )ds 



o 



D 



GD(x,y)f(y)dy. 



We set Gd equal to zero on the diagonal of D x D and outside D x D. Function Gd(x, y) is called 
the Green function of X D , or the Green function of X in D. For any x G D, Gd{ ■ ,x) is singular 
harmonic in D \ {x} and regular harmonic in D \ B(x, e) for every e > 0. When D = R d , it is well 
known that Gj^d(x,y) = c\x — y\ a ~ d where c = c(d,a) is a positive constant depending only on d 
and a. 

3 Generalized 3G theorem 

In this section, we prove the objective of this paper, the generalized 3G theorem ll.il in a bounded 
K-fat open set D. Let D be a K-fat open set with its characteristics (R, k), < k < 1/2. We fix R 
and k throughout this section. We collect and prove lemmas to prove the main theorem. 
For any ball B in R rf let Pb( x , z ) be the Poisson kernel for X in B, i.e., 



P X (X TB £ A) = [ P B (x, z)dz, AcH d \B. 

J A 



It is well-known that 



p , \ (r 2 -\x-x \ 2 2 1 

PB(x ,r){x,Z) = Ci 3.1) 

(\z - x \ 2 - r 2 ) 2 \x - z\ a 

for some constant c\ = c\(d, a) > 0. 

The next lemma can be proved easily using (|3,1|) (see 1291 138| ) . Since knowing the value of 7 
might be interesting for readers, we put a proof here. Moreover, with an eye towards the extensions 
in section 5, the following lemma will be proved without using (|3.1j) . Instead, we will use the fact 
that 

Pb(x,i)(x,z) > c(d,a)\x - z\- d ~ a , z £ H d \B(x,l), x £ R d . (3.2) 

Recall, from Definition ^. 3l that. for Q S dD and r G (0, R), there exists a point A r (Q) in DP\B{Q, r) 
such that B(A r (Q),Kr) C DnB(Q,r). Recall pd(x) = dist(x,dD). Note that kR < p D (A r (Q)) < 
r. 

Lemma 3.1 (Lemma 5 of J$ and Lemma 3.6 of There exist positive constants c = c(d, a, k) 
and 7 = 7(d, a, n) < a such that for all Q G dD and r G (0, R), and function u > 0, harmonic in 
D n B(Q, r), we have 

u(A s (Q)) > c(s/ryu(MQ)), s G (0,r). (3.3) 
In fact, there exists a small constant c\ = c\{d, a) > so that we can take 7 = a — ci(ln(2/K)) _1 . 
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Proof. Without loss of generality, we may assume r = 1, Q = and u(A r (Q)) = 1. Let r k := 
0/2) fe , A k := A rk (0) and B k := B{A k ,r k+1 ) for k = 0, 1, • • • . 

Note that the -B^'s are disjoint. So by the harmonicity of u, we have 

fc-l fc-i „ 

u(A k ) > Y,V Ak [<X TBk ) : X TBk G B t ] =J2 PB k (Ak,z)u(z)dz. 
1=0 1=0 Bl 

Since B k C B(A k , 2r k+ \) C D n B(0, r k ), The Harnack principle (Theorem 2.2) implies that 

/ P Bk (A k ,z)u(z)dz > ciu(Ai) P Bk (A k ,z)dz = Cl u(Ai)P Ak (X e Bi) 
Jb 1 Jb 1 

for some constant c\ = c\(d,a). By the scaling property of X, we have that 

?A k (X TBk e Bl ) = K-l^iKir-l^ e r&Bi) 
> c(r k _ l )- d [p^B^r^Ak)) ° > par^, 

for some constant C2 = C2((i, a). In the first and second inequalities above, we have used (|3.2|) and 
the fact that ps^Ak) < 2r\ respectively. Therefore, 

k-i 

(r k )- a u{A k ) > c 3 ^(n)-^(A) 

1=0 

for some constant C3 = c^{d,a). Let a k := r^ a u(A k ) so that a k > c^Y^iZo a i- By induction, 
one can easily check that a k > 04(1 + c^/2) k for some constant C4 = c^{d, a). Thus, with 7 = 
a — ln(l + ^)(ln(2//€)) , (|3.«S|) is true for s = r k . For the other values, use Harnack principle 
fTheoreml2~2l. □ 

The fact, 7 < a, is critical in the next section. As a corollary of the boundary Harnack principle 
(Theorem 12.4(1 . we immediately get the following Lemma. 

Lemma 3.2 There exists a constant c = c(D, a) > 1 such that for every Q £ dD, < r < R, we 
have 

G D {x,zi) < e G D (x,z 2 ) 
Gd{v,zi) ~ G D {y 1 z 2 y 



when x,y £ D\ B(Q,r) and Zi,z 2 £ Df] B(Q,r/4). 

Let M := 2k~ x and fix z £ D with 2R/M < p D (z ) < R and let £1 := R/(12M). For x,y £ D, 
we define r(x,y) := Pd(x) V Pd{v) V |x — y| and 

y) := ieD:^(i)> — r(a, y), |a - A| V |y - A| < &r(x, y) 
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if r(x,y) < £1, and B(x,y) := {zq} otherwise. 

By the monotonicity of the Green function and the formula for the Green function for balls (for 
example, see there exists a positive constant Cq such that 

G D (x,y) < C \x-y\- d+a , x,y^D (3.5) 

and that G D (x,y) > G B ^ y>pD ^(x,y) > C^\x - y\~ d+a if \x - y\ < Pd(v)/2. Let C\ := 
Co2 d ~ a pr>(zo)~ d+a so that Gd(-,Zq) is bounded above by C\ on D \ B(z , pd(z )/2). Now we 
define 

g(x) := G D (x,z ) A C\. 

Note that if pd(z) < 6ei, then \z — zq\ > pd(zo) — 6ei > pd(zq)/2 since 6ei < pd(^o)/4, and 
therefore g{z) = Gd(z,Zq). 

The lemma below immediately follows from the Harnack principle, Theorem 12.21 

Lemma 3.3 There exists c = c(D,a) > such that for every x,y £ D, 

c- l g{A x ) < g(A 2 ) < cg(Ax), A X ,A 2 e B(x,y). 

Using the Harnack principle and the boundary Harnack principle, the following form of Green 
function estimates has been established by several authors. (See Theorem 2.4 in [!?2] and Theorem 
1 in ,25.. Also see jlOj for a different jump process and see [301 f° r non-symmetric diffusion.) 



Theorem 3.4 There exists c = c(D, a) > such that for every x,y G D 

-i9{x)g{y), ,- d+a , n , % , g{x)g{y) , ,_ d+Q , _ r . , 

— T~7\b~ \ x y\ < G D (x,y) < c — 7~7Tn \ x ~ U\ , A£B(x,y). 3.6) 
g(Ay g{Ay 



Applying Theorem 13.41 we immediately get the following inequality. 

Theorem 3.5 There exists a constant c = c(D, a) > such that for every x,y,z,w G D and 
{A X; y, A Z)W , A X)W ) G B(x, y) x B(z, w) x B(x, w), 

G D (x,y)G D (z,w) < c g{y)g{z)g(A X)W ) 2 \x - w\ d ~ a 

G D (x,w) ~ C g(A x , y ) 2 g(A ZtW ) 2 \x - y\ d ~ a \z - w\ d ~ a ' { ' ' 

Using the Harnack principle, the proof of the next lemma is well-known (for example, see Lemma 
6.7 in JH])- We skip the proof. 



Lemma 3.6 (Lemma 2.2 in V£ty ) For every c\ > 0, there exists c = c(D,a,ci) > such that for 
every \x - y\ < ci{p D {x) A Pd{v)), G d (x, y) > c\x - y\~ d+a . 
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The following lemma is a direct application of Lemma 3.4 in jHH] and Lemma 4 in [3]. However, 
for the extensions in section 5, we prove here using Lemma 13.21 



Lemma 3.7 (Carleson's estimate) There exists a constant c = c(D,a) > 1 such that for every 
Q £ dD, < r < kR/4, y£D\ B(Q,4r) 

G D (x,y) < cG D (A r (Q),y), x € Df~)B(Q,r). (3.8) 

Proof. By Lemma 13.21 there exists a constant c = c(D,a) > 1 such that for every Q £ dD, 
< r < kR/4, we have 

Gd(x,v) ^ G D (x,z) 
< c - 



G D (A r (Q),y) ~ G D (A r (Q),z) 



for any x G D n B{Q,r) and y, z £ D \ B(Q,4r). Since r < kR/A, i.e., 4r/« < R, we can and 
do pick z = A± r / K (Q). Then by (|3,6[) and the inequality 1)3. 5 Jl . there exists a positive constant 
ci = ci(-D,a) such that 

G D {x,A Ar / K (Q)) 
G D (A r (Q),A 4r/K (Q)) <Cl ' 

which immediately implies the inequality (|3.8I) . Indeed, by (J3.5|) . 

G D (x,yl 4r/K (Q)) < C \x-A ir/K (Q)\- d+a < c 2 r- d+a 

since |x — A Ar / K (Q)\ > p£>(A Ar / K (Q)) — pd(x) > 4r — r = 3r. On the other hand, since 

8r 8 

\A r (Q) - A 4r/K (Q)\ < — < — (p D (A Ar/K (Q)) Ap D (A r (Q))), 
by Lemma 13.61 we obtain 

-d+a \ —d+a 



G D (A Ar/K (Q),A r (Q)) > c 3 \A r (Q) - A Ar/K (Q)\- a+a > c 3 r~ 



□ 



For every x, y G D, we denote Q x and Q y be points on (9L> such that pd(x) = \x — Q x \ and 
Pd(v) = \y — Qy\ respectively. It is easy to check that if r(x,y) < e\ 

A r (x,y)(Qx), A r (x,y)(Qy) G B(x,y). (3.9) 
In fact, by definition of A r ^ x ^(Q x ), p£>{A r ^ xy ^{Q x )) > nr{x,y) > r(x,y)/M. Moreover, 
\x ~ A(x,y)(Qx)\ < \x ~ Qx\ + \Qx ~ A r {x,y)(Qx)\ < Pd{x) +r(x,y) < 2r(x,y) 

and \y - A r ( x>y) (Q x )\ <\y -x\ + \x- A r{x>y) {Q x )\ < 3r(x,y). Thus we get 
Recall the fact that g{z) = Gd(z,zq) if Pd{z) < 6ei. 
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Lemma 3.8 There exists c = c(D,a) > such that for every x,y £ D with r(x,y) < E\, 

g(z) < cg(A r{x>y) (Q x )), z G DnB(Q x ,r(x,y)) (3.10) 

Proof. Note that for z G D n B(Q x ,2r(x,y)), p D (z) < 2e x . Thus g(-) = G D (-,z ) in D n 
B{Q x ,2r{x,y)). By Lemma[T3 we have o(z) = G D (z,z ) < cG D (A r{x ^(Q x ), z ) = cg(A r{x ^(Q x )) 
for z G D n B(Q x ,r(x,y)). □ 



Lemma 3.9 There exists c = c(D, a) > suc/t i/tai /or every x,y G -D 

g{x)yg{y) < cg(A), AeB(x,y). 

Proof. If r(x,y) > e\, then £(x,y) = {z } and y(x) V y(y) < C\ = g(z ). 

Now assume r(x,y) < e\. Since Pd(x) < r(x,y), x G D n B(Q x ,r(x,y)). Thus, by Lemma I3~%1 

y(x) < c s(A-(a:,i/) (Qa;)). 

Similarly, we obtain g(y) < cg(A r{xy) (Q y )). 

The lemma follows from Lemma 13.31 and (|3,9|) . □ 

Lemma 3.10 Ifx,y,z G D satisfy r(x,z) < r(y,z), then there exists c = c(D,a) > sitc/i i/iai 

y^x,?/) < cg(Ay >z ) for every {A x ^,A y>z ) G x B(y,z). 

Proof. If r(y, z) > ex, then ^(^L^) = C\ > g(A X)V ). Thus, we assume r(y,z) < e\. First, we note 
that 

r(x, y) < pd{x) V p D {y) V (\x - z\ + \z- y\) 

< pd{x) V p D (y) V \x - z\ + Pd{x) V p D (y) V \z - y\ < 2{r(x, z) + r(y, z)) < 4r(y, z). 

Here, the assumption r(x,z) < r(y,z) was used in the last inequality. So A r r x>y \(Q y ) G D n 
B(Q y , Ar(y, z)). Since <?(•) = Gd(-, zq) in -D n B(Q y , 6r(y, z)) and 6r(y, < kR/A, by Lemma l3~71 

#0) = G D (w,Zo) < cG D (^ 6r(yi2) (Q y ),Z ) = C5(^ 6 r(y, 2 )(<32/)) 

for w G D n B(Q y , 6r(y, z)). Here, we used |Q y — zq\ > /5d(zo) > 2R/M > 24r(y, z). In particular, 
with w = A r{X)y) (Q y ), 

9(A(x,y)(Qy)) < Cg( A 6r(y,z)(Qy))- 

By Theorem^ 9(^&r(y,z)(Qy)) = G D (A 6r ^(Q y ), z ) < ciG D (A r ^ z) (Q y ), z ) = cig(A rM (Q y )) 
for some c\ = ci(d, a). Thus 

g{A r (x,y)(Qy)) < C2 g(A r ( yiZ )(Q y )) 

for some C2 = C2(D, a). Using (|3.9j) we apply Lemma E01 both sides of the above functions and we 
have proved the lemma. □ 
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Lemma 3.11 There exists c = c(D, a) > such that for every x,y, z,w G D and (A Xty , Ay jZ , A Z)W , A XjW ) G 
B(x,y) x B(y,z) x B(z,w) x B(x,w), 

g(A x , w ) 2 < c {g(A x , y ) 2 + g(A y , z ) 2 + g(A z , w ) 2 ) . (3.11) 

Proof. Applying Lemma 13.101 to both cases r(x,y) < r(y,z) and r(x,y) > r(y,z), we get 

g(A x , z ) 2 < ci {g(A X)V ) 2 + g{A y)Z ) 2 ) . 

Obviously, using the above inequality twice, we get 

g(A x , w ) 2 < ci (g{A x , z ) 2 + g{A z , w ) 2 ) < a (c ig {A x , y ) 2 + c ig {A yjZ ) 2 + g{A z , w ) 2 ) . 

□ 

Recall 7 from Lemma 13. II 

Lemma 3.12 There exists c = c(D,a) > such that for every x,y G D with r{x,y) < E\, 

g(A r ( x ,y)(Qx)) A g{A r{Xty) (Q y )) > cr(x,yy. 

Proof. By symmetry, we show for A = A r ^ x ^(Q x ) only. Note that g(-) = G\d(-, zq) is harmonic in 
D n B(Q X , 2ei). Since r(x,y) < ei, by Lemma O (recall ex = R/(12M)), 

g(A) = G D (A,z ) > c (^^Y G D (A 2£1 (Q x ),z ). 

Note that p D (z ) > R/M = 12ei and Pd(A 2£i (Q x )) > 2e x /M. Thus bv Lemmal3~Kl G D {A 2ei (Q x ), z ) > 
ci > 0. □ 



Lemma 3.13 There exists c = c(D,a) > such that for every x,y,z G D and {A X)V , A yiZ ) G 
B(x,y) x B(y,z) 

g(A y , z ) < c (rj^zy A _ 



g(A x>y ) \r(x,y) 

Proof. Note that if r(x,y) > ei, g(A y<z ) < C\ = g{A XyV ). So three cases will be considered: 
a) r(x,y) < S\ and r(y,z) > e\: By Lemma 13.121 we have 

9 (A y , z ) < c Ci < cCl£ ^ r ^ z)1 



g( A r(x, y )(Qy)) r(x,y)-y r{x;y)i 

b) r(y,z) < r(x,y) < ex: Then A r r y )Z \(Qy) G D n B(Q y ,r(x,y)). Thus by Lemma 13.71 
g(A(y,z)(Qy)) < ^(^(^(Qj/)))- 



14 



c) r(x,y) < r(y,z) < E\: By Lemma l3~Tl 

9(A(y,z)(Qy)) < r(y,zy 
g(A(x,y)(Qy)) ~ r(x,yp' 

In all three cases, we apply Lemma 13.31 and we have proved the lemma. □ 



Lemma 3.14 There exists a constant c = c(D,a) > such that for every x,y,z,w G D and 
(A X) y,A ZjW ,A XtW ) G B(x,y) x B(z,w) x B(x,w), 

g{y)g{z)g{A x ^) 2 < / r(x,w) v A 7 / r(x,w) A 7 

s , (As,y) 2 s'(^.«,iB) 2 ~ v r ( a; >y) / v r ( z '' w ) / 

Proof. Note that 

9{y)g{z)g{A x ,w) 2 _ g(y)g(z) ( g(A x , w ) \ ( g{A x<w ) \ 

g(A x , y ) 2 g(A z , w ) 2 g{A X) y)g{A z , w ) \g(A Xjy ) J \g(A ZjW ) J ' 
By Lemma l3.9| we have 

g(y)g(z) < 

On the other hand, applying Lemma 13. 131 gives 

( g(A x , w ) \ f g{A XtW ) \ < c / r(g,w) s/ A 7 / r(x,w) s/ A 7 
V5(^,2/)/ \9{Az,w)J ~ \r(x,y) J \r(z,w) J 

□ 



Lemma 3.15 For every a,b,c> 0, we have 

(fvl) + (fvl) S 2(Svl)(fv.). 

Proof. By considering each case, it is clear. So we omit details. □ 



Lemma 3.16 There exists a constant c = c(D,a) > such that for every x,y,z,w G D and 
(A X; y,A ZjW ,A X)W ) G B(x,y) x B(z,w) x B(x,w), 

g(y)g(z)g(A x , w ) 2 < c / r(y,z) v A 7 / r(^,z) v A 7 
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Proof. From Lemma 13.111 we get 



g{y)g(z)g(A x , w ) ^ g{y)g{z) , , . , 2 , , A \2 



g(A X)y ) 2 g{A z , w ) 2 g{A x , y ) 2 g{A Z)W ) 2 



( g(y)g(z) | gCj/Mf) | g(y)g(z)g(A y , z ) 2 ' 



\g(A ZjW ) 2 g{A XtV ) 2 g{A x>y ) 2 g(A ZtW ) 2 J ' 
By applying Lemma 1331 to both y and z, we have that g{y) < cg(A XtV ) and g(z) < cg{A z w ). Thus 
(|3.12j) is less than or equal to 

c g(v) + c g(f) + c 2 f sKA/,*) ^\ s(A^) 



o(y) qfz) / r(y,z) J \ ( r(y,zV 

< c - ; ' - + c / a \ + ci [ vi , ; vi. 



g(A ZjW ) g(A x 

,y) \ r ( x ,y)' y J \r(z,w)' y 
We have used Lemma l3.13l in the last inequality above. Moreover, by Lemma l3.9l and Lemma 13.131 

g(y) = ( g(y) \ ( g( A y,z) \ < c ( r( y ,zp v 1 

g{A Z)W ) \g(Ay jZ )J \g(A z , w )J ~ \r(z,wp 

and 

g{z) _( g(z) \ (g(A y , z )\ < ^ / K^fF y 1 



We conclude that ()3.12|) is less than or equal to 

\\r(x,yp J \r(z,w)i J \r(x,yp J \r(z,wp 
for some C2 = C2(D,a) > 0. Using Lemma l3.15| we have finished the proof. □ 

Now we are ready to prove the main result of this paper. 

Proof of Theorem ll.il Let 

n< \ G D {x,y)G D (z,w) \x - w\ d ~ a 

G(x,y, z,w) := — — ■; r and H [x,y, z,w) ~ 



G D (x,w) v ' ' \x - y\ d ~ a \z - w\ d ~ a ' 

1. If \x — w\ < Pd(x) A pd(w), by Lemma 13.61 Gd{x,w) > c\x — w\~ d+a . Thus we have 
G(x, y, z, w) < cH(x, y, z, w). 

2. If \y — z\ < pn{y) A Pd(z), then by Lemma [3.61 Gn(v. z) > c\y — z\~ d+a . Moreover, from 
the classical 3G theorem (Theorem 6.1 in [SHI ) 5 we obtain that there exists a constant c = 
c(D, a) > such that 

G D (x,y)G D (y,z) G D (x, z)G D (z,w) 1 



G D (x,z) G D (x,w) G D (y,z) 

\x — z\ d ~ a \x — w\ d ~ a 1 

< c ! ! ! 

\x - y\ d ~ a \y - z\ d ~ a \x - z\ d ~ a \z - w\ d ~ a G D (y, z) 

\ x - w \ d ~ a 1 (3.13) 



" \x - y\ d ~ a \y - z\ d ~ a \z - w\ d ~ a G D (y,z) 
Thus, we have G(x, y, z, w) < cH(x, y, z, w). 
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3. Now we assume that \x — w\ > Pd{%) A pd(w) and \y — z\ > Pd(u) A Pd(z). Since Pd(x) V 
Pd(w) < Pd{x) A pd(w) + \x — w\, using the assumption pd{x) A pd{w) < \x — w\, we obtain 
r(x, u;) < 2|x — it; | . Similarly, r(y, z) < 2|y — z|. 

Let G £>(x,u;), E B(x,y) and Az jM , G £>(,z, w). Applying Lemmas 13.141 and 13.161 to 
(|3.7|) . we have 

G(x,y,z,w) < c— — - r — -^H(x,y,z,w) 

c / r(p)AfM) v V / r(p)Ar(i, m ) y \ ^ 
V K^y) / V r(z,w) J 

Now applying the fact that r(x,w) < 2\x — w\, r(y,z) < 2\y — z\, r(x,y) > \x — y\ and 
r(z, w) > \z — w\, we have (|1.3[) . 

We have proved the theorem. □ 



Remark 3.17 By letting y = z in (jl.3|) . we recover the classical 3G theorem, i.e., 
G D (x,z)G D (z,w) \x-w\ d - a ( 1 1 

\ C ^ Cl I T" 

Gd(x,w) ~ |x — z\ d ~ a \z — w\ d ~ a ~ \\x — z\ d ~ a \z — w\ 

Remark 3.18 See (3.2)-(3.3) in ^5] for a generalized version of 3G-estimate on bounded C 1 ' 
domains. Using Green function estimates in ^S], instead of Lemma 13.11 it is easy to see that 
7 = a/2 in (|1.3|) for bounded C ' domains. 



Remark 3.19 The inequality in (|1.3f) is not true even in smooth domains without the first two 
factors in the right-hand side of (|1.3j) : If D is smooth, by Green function estimate (for example, 
see 1151). there exists a positive constant c = c(D, a) such that 

Pd(v)pd(z)\x ~ w\ 2 V \x-w\ d ~ a < G D (x,y)G D (z,w) 



r(x,y) 2 r(z,w) 2 J \x — y\ d a \z — w\ d a Gd(x,w) 

Suppose the inequality in (J1.3|) is true without the factors. Then (|3. 15f) implies that there exists a 
positive constant c\ = c\{D,a) such that for distinct x,y,z,w in D 

pp(y)pp(z)\x-w\ 2 < ^ 1 
r(x, y) 2 r(z, w) 2 ~ 

But (|3.16l) can not be true. In fact, for points x ^ w € D near dD, choose y ^ z such that x ^ y, 
z ^ w, r(x, y) = Pd{x) = PD^y) > \x — y\ and r(z, w) = Pd(z) = Pd{w) > \z — w\. Then, 

PD(y)PD(z)\x - w\ 2 _ \x-w\ 2 



r(x,y) 2 r(z,w) 2 pd(x)pd{w) 



oo as x —* 9-D. 
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4 Concrete sufficient conditions for the non-local Kato class and 
relativistic stable process 



Throughout this section D is a bounded re-fat open set. In this section, we recall the new (non-local) 
Kato class introduced by Chen and Song ([8| I16| IT3]). Then we apply the generalized 3G theorem 
to establish some concrete sufficient condition for functions to be in the non-local Kato class. Using 
this sufficient condition, we discuss some properties of relativistic stable process in bounded re-fat 
open sets. 

We will use the definitions for the new Kato class not only for symmetric stable process, but 
also for other symmetric Hunt processes, which will be specified later. So we will denote Y for 
those processes in D, G(x,y) for the Green function for Y and will state the following definition 
for Y, Note that the processes in this paper are irreducible transient symmetric Hunt processes 
satisfying the assumption at the beginning of section 3.2 in jSj. 

We call a positive measure \i on D a smooth measure of Y if there is a positive continuous 
additive functional (PCAF in abbreviation) A of Y such that 



for any Borel measurable function / > 0. Here | nm tj.o means the quantity is increasing as t J. 0. 
The measure /i is called the Revuz measure of A. For a signed measure fj,, we use \x + and ^ to 
denote its positive and negative parts respectively. If // + and \i~ are smooth measures of Y and 
A + and A~ are their corresponding PCAFs of Y, then we say the continuous additive functional 
A := A + — A~ of Y has (signed) Revuz measure \i. 

Definition 4.1 Suppose that A is a continuous additive functional of Y with Revuz measure v. 
Let A + and A~ be the PCAFs (positive continuous additive functionals) ofY with Revuz measures 
u + and v~ respectively. Let \A\ = A + + A~ and \v\ = v + + v~ . 

(1) The measure v (or the continuous additive functional A) is said to be in the class Soo(^) if for 
any e > there are a Borel subset K = K(e) of finite \u\-measure and a constant 5 = 5(e) > 



(2) A function q is said to be in the class S OQ (Y), if v(dx) := q(x)dx is in the class S^iY). 




(4.1) 



such that 




and that, for all measurable set B C K with \v\(B) < 5, 
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Let (N, H) be a Levy system for Y in D, that is, for every x £ D, N(x, dy) is a kernel on 
(.Dq, B(Dg)), where d is the cemetery point for process Y and Dq = D U {9}, and i?t is a positive 
continuous additive functional of Y with bounded 1-potential such that for any nonnegative Borel 
function /onflx Dq that vanishes along the diagonal d, 

E - |E^-< y *)j = Ex (j j D f^y) N{ y^ d y) dH ^ 

for every x £ D (see (37] for details). We let fj,n(dx) be the Revuz measure for H. 

Definition 4.2 Suppose F is a bounded function on D x D vanishing on the diagonal. Let 

V\F\(dx) := (J^\F(x,y)\N(x,dy) \ nn{dx). 

(1) F is said to be in the class Aoo(Y) if for any e > there are a Borel subset K = K(e) of 
finite [i\ F \-measure and a constant 5 = 5(e) > such that 

J(DxD)\(KxK) G(x,u;J 
and that, for all measurable sets B C K with [i\p\(B) < 5, 

J (BxD)yj(DxB) Lr{X,W) 

(2) F is said to be in the class A2(Y) if F £ A^Y) and if the measure fj,\p\ is in Sq^Y). 



sup 

(x,w)e(DxD)\{x=w} J(DxD)\(KxK) 



sup 

(x,w)e(DxD)\{x=w} J (BxD)yj(DxB) 



By (|2.4j) . Levy system [N , H ) for symmetric stable process X can be chosen to be 

N D (x,dy) = 2J(x,y)dy = A{d, ~ a Jj y in D and H? = t, (4.2) 

\X — y\ a + a 

where J(x, y) is given in (|2,2[) . By (|4.1|) . the Revuz measure [i h d (dx) for H D is simply the Lebesgue 
measure dx on D. (see Theorem 4.5.2, Theorem 4.6.1, Lemmas 5.3.1-5.3.3 and Theorem A. 3. 21 in 
|21| for the relation between (regular) Dirichlet form and Levy system.) 

Using the generalized 3G theorem (Theorem II. lj) . now we can give a concrete condition for a 
function F to be in class A2(X D ) on any bounded K-fat open set D. For w E D, We denote by 
the expectation for the conditional process obtained from X D through Doob's /i-transform with 
h(-) = Gp,(-,w) starting from x £ D. 

Theorem 4.3 If D is a bounded K-fat open set and F is a function on D x D with 

\F(x,y)\ <c\x-yf (4.3) 
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for some [3 > a and c > 0, then F G A.2^X ) and 



sup 

(x,w)eDxD 



S<TD 



< oo. 



(4.4) 



Proof. First let us show that F E Aoo. Since D is bounded, by the Generalized 3G theorem 
( Theorem 11,1(1 . there exists a positive constant c = c(D,a) such that 

G D (x,y)G D (z,w) 



< c 



G D (x,w) 
1 



-a+7 



+ 



2 — 10 



-a+7 



|x - y\ c 

\ y _ z \d- a+1 



+ 



id— a 



+ 



\y-z 



d— «+7 



\y - Z \ d - a+2 ^ 



\x - y\ d ~ a+ ^\z - w\ d ~ a \x - y\ d ~ a+, y\z - w\ d ~ a+ ~r J ' 

Thus, by the assumption on F, (|4.3|) . and (|4.2|) . we obtain 

G D (x,y)|F(y,z)|G D (z,u;)^ D (y,dz) G D (x, y)G D (z, w) 

< c- 



(4.5) 



1 



G D (x,w) 



< c 



1 



+ 



G D (x,w) \y-z\ d+a -P 
1 



+ 
+-, 



|x - y| d " Q+7 |y - z^+^-f 3 \y - z\ d+a ~P\z - w\ d - a +i 
1 1 



+ 



x - y\ d ~ a \y - z\ 2a -P\z - w\ d ~ a \x - y\ d ~ a \y - z\ 2a -^-'y\z - w\ d - a+ ~t 

1 1 

+ 



x - y\ d ~ a+ ^\y - z\ 2ol -P- 2 ~<\z - w\ d - a +"i 



1.6) 



\ x - y\d- a +~/\ y _ z |2a-/3- 7 | z _ w \d-a 

Since 7 < a < [3, 

{(y, z)»\x- y\ a -^ d \y - zf~ a ~\ x G D}, 
{{y, z)^\z- w\ a ^- d \y - zf- a ~ d , w £ D} 

are uniformly integrable over cylindrical sets of the form B x D and D x B, for any Borel set 
BCD. 

Now let us show that the following family of functions are uniformly integrable over cylindrical 
sets of the form B x D and D x B: 

(4.7) 
(4.8) 
(4.9) 
(4.10) 

We apply Young's inequality ab < ^a p + |& 9 for some p, q > 1 satisfying 



{(v,*) 


1 — ► X 


-yr 




a- 


- d \y-zt 


- 2a , x,w £ D}, 


{(y,z) 


1 — ^ |x 




" d 2; - id 


a- 


-~<- d \y-z 


/3 " 2a+7 , x,w G £>}, 


{(y,z) 


1— > X 




- 7_d |z- 




a ~ d \y-z 


/3 - 2a+7 , x,w G £>}, 


{(y,z) 


1— > X 




-7-d|s_ 


u; 


a -^- d \y- 





= 1. 



(4.11) 
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1. First, let us consider the function ()4.7|) when the exponent of \y — z\ is negative, i.e., < 2a. 
Otherwise it is obvious that the function (|4.7j) is uniformly integrable since D is bounded. 
Applying Young's Inequality, we obtain 



\ x _ y \«-d\ z _ w] *-d\ y _ z ^-2a = Q x _ y \\ z _ w \) a ~ d \y - z f-*> 

<U\ X -y\\z- W ^- d)V ^-\y-z\^. 
p\ J Q 

It suffices to find p, q > 1 satisfying (|4.11|) and 

(d - a)p < d, (2a - 0)q < d. (4.12) 

Choosing p in the interval 

d \ d 
1 V - — < p < 



d — 2a + (3 J d — a 

we can finish this case. Note that this interval is not empty since — < — — — by 

d — 2a + (3 d — a 

(3 A d > a and > 1. 

a — a 

2. For the function <|4.1U|> . we replace a by a — 7 in the previous case. Here note that < 
a - 7 < (3 A d. 

3. Now let us consider the function ([4.8)1 only when the exponent of \y — z\ is negative, i.e., 
/3 + 7 < 2a. 

\x - y\ a ~ d \z - w\ a ^- d \y - z f- 2a+ ~< 

= (\x -y\\z- w\) a ~ d (\z - w\^\y - zf~ 2a+ ^ 

<-(\x-y\\z- w\) (a ' d)P + -\z - w\^ q \y - z \^- 2a+ ^ q . 
p\ J q 

We find p, q > 1 satisfying (|4.11|) and 

(d - a)p < d, jq < d, (2a - P - j)q < d. (4.13) 

Choose p in the interval 

d d \ d 
1 V V < p < 



d — ^y d — 2a + /3 + 7/ d — a 

This interval is not empty. Clearly, — > 1. Also, — > — since < 7 < a < d. 

d — a d — a d — 7 

d d 

Finally, > since d > a > a — (J3 — a) — 7 = 2a — (3 — 7, a < (3. 

d — a d — 2a + p + 7 
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4. Analogously to the previous case, the function (|4.9|) can be considered. 
Thus F is in A. 00 (X D ) and, moreover, 



sup 

(x,w)GDxD JD J D 



G D (x,y)G D (z,w) 



F(y, z)\y - z\ d a dydz < oo. 



G D (x,w) 

Note that, by Proposition 3.3 in ^5] and (|4.2j) . 



En*?-*?) 



1<TD 



A(d,-a) / / 



G D (x,y)G D (z,w) 
d G D (x,w) 



F(y,z)\y-z\- d - a dydz. 



Therefore we have (|4.4|) . 
Since 



/i|F|(ds) = .A(d,-a) M |F(x,y)||x-yr Q - d (i^ (fx < (J c\x - yf~ a ~ d dy^J dx<cdx, 
it follows from ()4.5|) with y = z that n\p\ G S 00 (X Z) ) and therefore F is in A2pT D ). 



□ 



Fix xq £ D and set 



M D (x,y) :-- 



Gp(x,y) 
GD{x ,y) 



x,y G D. 



It is shown in 1381 that 



Md(x,z) := lim M£>(x,y) exists for every z £ <9D, 



(4.14) 



which is called the Martin kernel of -D, and that Me>(x,z) is jointly continuous in Z? x <9D. For 
each z £ dD, set Md(x, z) = for x € .D c . For each z £ (9.D, x i— >• Md(x, z) is a singular harmonic 
function for J in D (see pages 415-416 of |38) for details). We get the following as a corollary of 
the generalized 3G-inequality. 



Corollary 4.4 For every x,y,z € D and w G dD, there exists a constant c = c(D, a) > such 
that 

\d—a 



G D (x,y)M D (z,w)_ / |x - w| A |g/ - z, v ( 



Md{x, w) 



\x - y 



x — w\ A |y — z| 



V 1 



z — u; 



x — it; 



1^ ~~ y\ d a \z — w\ d 



(4.15) 



Let H + (X D ) be the collection of all positive singular harmonic function of X in D. We denote 
E^ the expectation for the conditional process obtained from X D through Doob's /i-transform with 
h{-) starting from x £ D. i.e., 



K [fix-, 



E„. 



HX?) /Mr m 



h(x) 
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When h(-) = M D (-,w) with w G dD, we use E™ instead of E™ dM . 

The next result can be proved easily with an argument similar to the argument in the proof of 
Proposition 3.3 in |16| . We put the details for the reader's convenience. 

Proposition 4.5 For every (3 > a, 



sup E* 

x€D,h£H+(X D ) 



< oo. 



(4.16) 



S<TD 

Proof. For every h G H + {X D ), Mt := h(XP)/h(Xo > ) is a super martingale multiplicative func- 
tional of X s . It follows from Section 62 of [HU that 



E; 



E, 



E x 



1 



£ |Xf_ - Xf f ( P l {s<r < TD} d(-M r ) + M TD ) ;t<r D 



s<t 



s<t 



h(x] 
1 

Ux)" x 



J2\X?--X?fM s] t<r D 



-E 



E, 



s<t 

t 



JD 



\Xf -yfh(y)N D (X?,dy)dH, 



D 



Thus by (IP) 



E; 



S<T D 



h{x)~ 



-E, 







|Xf -yfh(y)N D (X°,dy)dH ; 



D 



A(d,-a) [ [ GD{x ^\ h{z) \y-z\-^dydz. 
JdJd h(x) 



Note that since, by Corollary 14.41 



G fl (i,j/)M D (z,w) Lj „i-d-a+0 



M D (s,u;) 

is bounded above by (|4.6ft . following the argument in the proof of Theorem 14.31 we get 



sup 

(x,w)GDxdDJD JD 



M D (x,w) 



oo. 



(4.17) 



(4.18) 
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Thus (I4~TK1) and (ETTTl) with h(-) = M D (-,w) imply that 



sup 

(x,w)eDxdD 



S<T D 



< oo. 



(4.19) 



On the other hand, from the Martin representation ((4.1) in [2B|)> for every h 6 H + (X D ), there 
exists a finite measure \i on <9L> such that h(x) = J dD Mjj(x,w)n(dw). Thus by (|4.17j) and (|4.19|) . 



Ei*f--* 



D\f3 



1<TD 



Since < h(x) < oo, we have (|4.16|1 . 



do 



M D {x,w)n™ 



S<TD 



fi(dw) 



< c Mo(x,w)fj 1 (dw) = ch{x). 

JdD 



□ 



For the remainder of this section, we will discuss some properties of relativistic a-stable process 
in bounded re-fat open sets. This process have been studied in ^2 El HH 155] - We will recall 
the definition of relativistic a-stable process and its basic properties. We will spell out some of 
the details for the readers, who are unfamiliar with the non-local Feynman-Kac perturbations (cf. 

[Hi main]). 

For < a < 2, a relativistic a-stable process X m in R d is a Levy process whose characteristic 
function is given by 



E [exp (i£ • (X? - X^))] = exp l-t (|£| 2 + m 



,2/aW2 



where m > is a constant. In other words, the relativistic a-stable process in R d has infinitesimal 
generator m — (—A + m 2 / a ) Q / 2 . It is clear that X m is symmetric with respect to the Lebesgue 
measure dx on R d and that when the parameter m degenerates to 0, X m becomes a symmetric 
a-stable process X on R rf . 

The Dirichlet form (Q,D(Q)) of X m is given by 

Q(u, v) := f ^ mm ((Id 2 + m 2 / Q ) Q / 2 - m) ^ 



and 



D(Q) : = {n G L 2 (R d ) : / |fi(fl| 2 ((|f| s 



+ m 



2/a\a/2 



m) d£ < oo}. 



where u(f) = (2vr)- d / 2 J Rd e i ^u(y)dy (see Example 1.4.1 of EU). Recall (£,.F) from lf2~T|) . Similar 
to fi, we can also define Q\. From ()2.1|) . we see that there exist positive constants ci = c\(m) and 
C2 = C2(m) such that 

ci£i(tt,ii) < Qi(u,u) < c 2 £i(u,u). (4.20) 



Therefore D(Q) = T . From now on we will use T instead of D(Q). 
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Like symmetric stable processes, relativistic a-stable processes can be obtained from Brownian 
motions through subordinations. For the details, we refer our readers to (S3- By Lemma 2 in |35j . 
the Levy measure for relativistic a-stable process has the density 

„(x) : = — ^— r^uy^e-^e-^u-^du. 
21 I 1 ~ 2 J JO 

Using change of variables twice, first with u = \x\ 2 v then with v = 1/s, we get 

u(x)=A(d, -a)\x\- d - a ^{m l / a \x\) 

where 

4>(r) := 2"( rf+Q ) r 1 J™ s^-^-i-T ds, 

which is a smooth function of r 2 (see pages 276-277 of 14 for the details). Recall J(x,y) from 
(|2.2|1 . The Levy measure v{x)dx determines the jumping measure J m of X m : 

J m (x,y) := X -v{x -y) = ~A(d, -a)\x - y\~ d - a ^(m l ^\x - y\) = J(x,y)^(m^ a \x - y\) 
Thus the Dirichlet form Q of X m can also be written as follows 



Q(u,v) = / / (u(x) -u(y))(v(x) - v(y))J m (x,y)dxdy. 
Jn d JR, d 

For a bounded re-fat open set D, let X m,D be killed relativistic stable process in D with param- 
eter m > 0. From (|4.20|) . we have that the Dirichlet form of X m,D is (Q,J- D ), where J- v is given 
in (|2.3|) . For any u, v G 



where 



Q(u,«)= / / (u{x) - u{y))(v(x) - v(y))J m {x,y)dxdy + I u(x)v(x)K™(x)dx, (4.21) 

JD Jd J D 

K 1 E(x):=2j J m (x,y)dy = A{d, -a) [ \x - y\- d ~ a i;(m l/a \x - y\)dy. (4.22) 

Let , 

F m (x,y) := I ^ - 1 = ^(mV«|x - y|) - 1 
J(x,y) 

and with kd(x) given in (|2.5() 

(7 m (x) : =^(x)- KD (x)=^(d,-Q) / F m (x,y)|x-yr d - a dy. 

Since i\){m}-l a \x — y\) is a positive continuous function and D is bounded, inf x>ye D F m (x,y) > — 1. 
We know that ip(r) is a smooth function of r 2 and ip(0) = 1. Thus, there exists a constant 
c = c(D, a, m) > such that 

\F m (x,y)\ < c\x-y\ 2 , for x,y£D. (4.23) 
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Thus by Theorem 14.31 



F m £A 2 (X D ) and ln(l + F m ) G A 00 (X U ). 



(4.24) 



Moreover, by (fOHj). 



(x) < ci / |x - y| 



-d-a+2 



dy < C2Pd(x) 2 a , x G D. 



So using the 3G theorem, q m G 5oo(X D ). 
Let 



iT-:= expf Y, Hl + F m (X?_,X?))-A(d,-a) f [ F m (X 

\0<s<t J ° jD 

- f\ m {X°)ds 



D „.\| V D 

s i 



y)\X^ -y\~ d ~ a dyds 



Using the multiplicative functional K™, we define a semigroup Q™] 

QTf{x) := B x [f(X t D )K?] , x G D. 

Then by Theorem 4.8 of ^3], Q™ is a strongly continuous semigroup in L 2 (D, dx) whose associated 
quadratic form is (C,^ 70 ), where 



(u(x) -u(y))(y(x) - v(y))(l + F m (x, y)) J(x, y)dxdy 



D JD 



+ / u(x)v(x)nD(x)dx + / u(x)v(x)q m (x)dx 
Id Jd 



C(u, v) 



(u(x) — u(y))(v(x) — v(y))J m (x,y)dxdy + / u(x)v(x)K^j(x)dx 
idJd Jd 

for u, v in T D . Thus by (|4.21|) . the quadratic form associated with Qf 1 is exactly the Dirichlet form 
(Q,F D ) of X m > D . Therefore X m can be obtained from X through the Feynman-Kac transform 
K?. That is, 




E, 



m,D\ 

t i 



E x [f(X?)K?] 



for every positive Borel measurable function /. Since X m ' D is transient (for example, see Theorem 
3.2 in |14j). by Theorem 3.10 in jHj, we get the following theorem, which extends Theorem 3.1 in 

M- 

Theorem 4.6 There exists Green function Vu(x,y) for X m in D, jointly continuous on D x D 
except along the diagonal, such that 



V D {x,y)f{y)dy = E 2 



D 



TD 



f{Xf)ds 
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for every Borel function f > on D. Moreover, there exists a positive constant c = c(m,a,D) 
such that 

c~ l G D {x,y) < V D (x,y) < cG D (x,y), x,y G D, 
and for every x,y, z,w E D 

VD{x,y)VD{z,w) ^ / \x — w\ A \y — z\ \ 7 / \x — w\ A \y — z\ ^\ 7 \x — w ld ~'' 



Vd(x,w) \ 1^ — y\ J V \ z ~ w \ ) \ x ~ y\ d a \z — w\ d a 

(4.25) 

Since the jump measure of X m is \v(x — y), we see that Levy system (N m , H m ) for X m,D can 
be chosen to be 

N m (x,dy)=2J m (x,y)dy= A{d '~^ {m ^2 X ~ yl) dy ^ D and H? = t (4.26) 

\X — y\ a + a 

and the Revuz measure ^Hm(dx) for H m is simply the Lebesgue measure dx on D (cf. |21|). Thus 

N m {x,dy) < N D (x,dy) in D. (4.27) 



Theorem 4.7 If D is a bounded n-fat open set and F is a function on D x D with \F(x,y)\ < 
c\x — y\P for some (3 > a and c > 0, then F G A.2{X m,D ) and 



(x,w)€DxD 



sup EJ. 



S<T D 



< oo. 



Proof. By Theorem 14.61 and l|4.27|) . Gd(x, y)Go{z, w)/Gd(x, w) is bounded above by (|4.5|) . So by 

Gfl(g.y) I F(y,z)\G D (z,w) N m (y,dz) 
Gd(x,w) dz 

is bounded above by (|4.6j) . Now following the remainder argument in Theorem 14.31 we get the 
result. □ 

In Chen and Kim an integral representation of nonnegative excessive functions for the 
Schrodinger operator is established. Moreover it is shown that the Martin boundary is stable under 
non-local Feynman-Kac perturbation. As mentioned in section 6 of jllj . the method in jllj works 
for a large class of strong Markov processes having a dual process. In particular, Theorem 3.4 (3) 
jllj is true for symmetric stable processes in bounded K-fat open sets. Applying Theorems 3.4 and 
5.16 in to symmetric stable and relativistic stable processes in bounded re-fat open sets, we 
have the following from our Theorem 14.61 
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Theorem 4.8 For every x £ D and w G dD, K(x,w) := ]im y ^ W)y< z£) y^^oy) ea ^ s an d * s finite. 
It is jointly continuous on D x dD. Moreover, there exists a positive constant c such that 

c~ l M D (x,w) < K D {x,w) < cM D {x,w), x £ D,w £ dD, 

and for every x,y, z,w £ D 
Vd(x, y)Kr){z, w) ^ f \x — w\ /\\y — z\ ^ / \x — w\ f\\y — z\ ^ ^ \x — w ]d ~" 



Kd{x,w) \ \x — y\ J \ \z — w\ J \x — y\ d a \z — w\ d a 

(4.28) 

Theorem 4.9 For every singular positive harmonic function u for X m in D, there is a unique 
finite measure u on dD such that 



u{x)= / K D {x,z)v{dz). (4.29) 

JdD 

Thus the Martin boundary and the minimal Martin boundary for relativistic a-stable process X m 
in D can all be identified with the Euclidean boundary dD of D. 

When u is singular harmonic in D for X m , the measure v in (J4.29|) is called the Martin measure 
of u. Let H + (X m,D ) be the collection of all positive singular harmonic function of X m in D. 
We denote the expectation for the conditional process obtained from X m,D through Doob's 
/i-transform with h(-) starting from x £ D. 



Proposition 4.10 For every (3 > a, 



sup 



x€D,h€H+(X m , D ) 



]T \x^ D -x^ D f 

S<T D 

Proof. Using Theorem 14.61 14.81 and 14.91 the proof is almost identical to the proof of Proposition 
14.51 So we skip the proof here. □ 

The boundary behavior of harmonic functions under non-local Feynman-Kac perturbations has 
been studied by the first named author |271 128j . In |^5j, it is proven that the ratio u/h of two 
singular harmonic functions for X m in an bounded C 1 ' 1 -open set has non-tangential limits almost 
everywhere with respect to the Martin measure of h. Due to 1)4 .24|) . now we can apply Theorem 
4.7 in to X m in bounded K-fat open sets and extend the result in Theorem 4.11 |2*5] . 

Recall the Stolz open set for K-fat open set D from [2*8] : For Q G dD and > (1 — «)/«, let 

A% :={y£D; \y - Q\ < (3p D (y)} . 

Theorem 4.11 Suppose D is a bounded n-fat open set. Ifk and u are singular harmonic functions 
for X m in D and v the Martin measure for k. Then for u-a.e. Q G dD, 

i- U ( X ) ■ + S a 1 ~ K 

hm — -- exists for every p > . 

AP Q 3x-*Q K x ) k 



< oo. (4.30) 
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5 Extension 



As we mentioned in the introduction of this paper, to keep our exposition as transparent as possible, 
we have chosen rotationally invariant symmetric a-stable process to present our result. However 
our approach works for a large class of symmetric Markov processes. We have not attempted to 
find the most general condition where generalized 3G theorem is true. However we like to point 
out that the generalized 3G theorem extends to any symmetric Markov processes satisfying the 
conditions below. We put these in terms of Green function Gd(x, y)- 

There exist positive constants ro, 7, M and Co such that the following holds: 

(CI) (Lemma 13. lj) For all Q G dD and r G (0, ro), we have 

G D (A s (Q),z ) > c (s/r)"<G D (A r (Q),z ), s G (0,r). 

(C2) (Theorem I2.2|) Let y,x\,X2 G D and x±,X2 G D \ B(y, pjj(y)/2) such that \x\ — X2I < 
L(pd(xi)Apd(x2))- Then there exists a constant c := c(L) such that Gd(x2, y) < cGd(xi,?/). 

(C3) G D (x, y) < c \x - y\~ d+a and G D (x, y) > c^x - y\~ d+a if \x - y\ < p D (y)/2. 

(C4) (Xemma I3.2|) For every Q G dD and r G (0, ro), we have for x,y G D\ B(Q,r) and 
Zi,Z3 G DnB{Q,r/M) 

G D (x,z 1 ) G D (x,z 2 ) 

*c c . 

Gd{v,Zi) ~ G D (y,z 2 )' 

It is well-known that (C2)-(C4) implies Green function estimates (Theorem 3.4) (for example, 
see [^2] f° r a similar setup and the conditions equivalent to the condition (C4)). Under the above 
conditions (C1)-(C4), all the results in Sections 3 hold through the same argument. 

Moreover, if the symmetric Markov process is a stable (Levy) process, we know from the proof 
of Lemma 13. II that (|3.2j) implies (CI) with 7 < a. 

In the remainder of this section, we discuss the generalized 3G theorem for another type of 
jump processes. Recently a class of (not necessarily rotationally invariant) symmetric a-stable 
Levy process was studied in and [22] ■ Let a be the surface measure on 8B(0, 1) = {\y\ = 1}. For 
any a G (0, 2), a-stable Levy process Z = (Z t , P x ) is a symmetric Levy process in R rf such that 

E [exp(i£ • (Z t - Zq))\ = exp(-t$(0) for every x G R d and £ G H d . 

where 

H0-= I \yZ\ a f(y)<r(dy) (5.1) 

J{\v\=i} 

and / is a symmetric function on {\y\ = 1} with < c^ 1 < f < c\ < 00. When f = c for 
some appropriate constant, Z is a rotationally invariant symmetric a-stable process X, which we 
considered in Sections 2-3 (see [H] and [HH] for details). 
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Recall that a bounded domain D is said to be Lipschitz if there is a localization radius r > 
and a constant A > such that for every Q E dD, there is a Lipschitz function <f)Q : R d_1 — > R 
satisfying (/>q(0) = 0, |0q(») — 0q(#)| < A|x — z|, and an orthonormal coordinate system y = 
(yi, ■ ■ ■ ,yd-i,yd) ■= (ViVd) such that B(Q,r) D D = B(Q,r) n {y : y d > 4>Q{y)}. It is easy to see 
that D is K-fat with characteristics (r, k) with k = (2\/l + A 2 ) -1 . 

^From PHI, we see that, if L> is a bounded Lipschitz, the conditions (C2)-(C4) are true (see 
(2.3)— (2.4), Lemma 3.3-3.4 and Theorem 4.2 in Moreover, by Lemma 3.3 in [5], the condition 

(CI) is true with 7 < a. Thus we have the generalized 3G theorem for Z. 

Theorem 5.1 If Z is symmetric a-stable Levy process and D is bounded Lipschitz, the inequality 
U.cl\) is true with some < 7 < a. 

Since the density of the Levy measure for Z is comparable to |x| _d_Q ((2.1) in ,39 ), we have 
the following theorem. The argument of the proof is the same as the ones in the proofs of Theorems 
14.31 and 14.71 So we skip the proof. 

Theorem 5.2 Suppose Z is symmetric a-stable Levy process and D is bounded Lipschitz. If F is 
a function on D x D with \F(x,y)\ < c\x — y\@ for some j3 > a and c > 0, then F G A2(Z D ) and 

sup 

(x,w)eDxD 

Acknowledgment: The first named author of this paper thanks Professor Renming Song and 
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